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1.  Introduction. 

We  consider  in  this  paper  two  Markov  processes  X = {x(t),  t >.  0} 
and  Jp  = {x#(t),  t >.  0}  having  stationary  transition  probabilities 
and  state  space  S = [0,°°)  . Both  X (called  the  storage  process) 
and  (called  the  risk  process)  are  defined  in  terms  of  a function 

r : S -*■  [0,°°)  and  a compound  Poisson  process  A = (A(t),  t >.  0} 
having  positive  jumps.  We  denote  by  X and  F( • ) the  jump  rate  and 
jump  size  distribution  respectively  of  A , so  that  0 < X < 00  and 
F(o)  = 0 . We  assume  that  r(0)  = 0 and  that  r(*)  is  strictly 
positive,  is  left  continuous,  and  has  a strictly  positive  right  limit 
r®A  • ) on  (O,00)  . Thus  r is  bounded  away  from  zero  on  any  compact 
subset  of  (O,00)  . We  further  assume  the  behavior  of  r near  zero 
to  be  such  that 


^y 


(1) 


R(x)  = 


dy  < 


00 


xlO  , 


(Throughout  the  paper,  integrals  are  understood  to  he  over  open  in- 
tervals unless  we  explicitly  indicate  otherwise.) 

The  process  X = {X(t),  t >_  0}  , which  we  formally  define  by 
construction  as  in  [4]  , satisfies  the  storage  equation 


X(t)  = X(0)  + A(t)  - 


■t 

r (X( s ) )ds  , 

J0 


t >.  0 . 


¥e  interpret  X(t)  as  the  content  at  time  t of  a storage  system 
such  as  a dam,  A(t)  as  the  input  to  the  system  during  the  interval 
[0,t]  , and  r(x)  as  the  rate  at  which  material  flows  out  of  the  sys- 
tem when  its  content  is  x . Thus  r(x(s))ds  represents  the  total 
output  from  the  system  during  [0,t]  , and  the  storage  equation  says 
simply  that  current  content  equals  initial  content  plus  cumulative 
input  minus  cumulative  output . The  paths  of  X are  absolutely  con- 
tinuous and  non-increasing  between  positive  jumps  generated  by  A . 

The  quantity  R(x)  represents  the  time  required  for  X to  move 
from  state  x down  to  state  zero  in  the  absence  of  any  input  (jumps). 
Thus,  assumption  (l)  requires  that  state  zero  be  accessible  from  any 
starting  state. 

In  our  previous  paper  [4] , we  calculated  the  generator  of  X , 
provided  a necessary  and  sufficient  condition  for  positive  recurrence, 
and  calculated  the  unique  stationary  distribution  in  the  positive  re- 
current case.  In  Section  2 of  this  paper  we  complete  the  recurrence 
classification  of  X , providing  necessary  and  sufficient  conditions 
for  null  recurrence  and  transience , 
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The  risk  process  X^  = {X^(t),  t >.  0}  is  defined  by  construction 

in  Section  3.  One  may  interpret  X^(t)  as  the  size  of  an  insurance 

company's  risk  reserve  at  time  t . The  paths  of  X^  are  strictly 

increasing  and  absolutely  continuous  between  jumps,  the  instantaneous 

rate  of  increase  being  r(X^(t))  at  time  t . The  jumps  of  X^  are 

all  downward.  They  occur  at  the  same  Poisson  times  and  have  the  same 

absolute  magnitude  as  those  of  A , except  that  jumps  are  truncated 

u 

as  necessary  to  keep  non-negative.  The  downward  jumps  correspond 

to  the  occurrence  of  claims  against  the  company.  The  continuous  up- 
ward movement  of  iP  between  jumps  corresponds  to  the  receipt  of  pre- 
mium payments  from  policyholders.  By  allowing  the  instantaneous  in- 
come rate  r to  depend  on  the  size  of  the  risk  reserve,  we  are  able 
to  represent  a situation  where  management  changes  the  fraction  of  pre- 
mium income  that  is  channelled  into  the  risk  reserve  (rather  than  in- 
vested) as  the  size  of  the  reserve  fluctuates.  * In  traditional  collec- 

§ 

tive  risk  theory,  attention  is  focused  on  the  probability  that  T7 
will  ever  hit  zero  (the  probability  of  ruin) , and  our  truncation  of 
those  jumps  that  would  drive  the  process  negative  is  irrelevant  for 
this  calculation. 

As  we  shall  demonstrate  in  Section  4,  the  analytical  problems 

U 

which  arise  in  the  recurrence  classification  of  Xff  are  identical  to 
those  encountered  in  the  classification  of  X . It  will  be  shown  that 
X^  is  positive  recurrent  iff  X is  transient,  null  recurrent  iff  X 
is  null  recurrent,  and  transient  iff  X is  positive  recurrent.  Fur- 
thermore, in  the  case  where  X^  is  transient,  the  probability  of  ruin 
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(viewed  as  a function  of  the  initial  risk  reserve)  has  the  same  density 
as  the  stationary  distribution  of  X . A similar  duality  between  the 
two  processes  is  found  in  the  case  where  X^  is  positive  recurrent 
and  X is  transient. 

In  Section  5 we  consider  the  special  case  where  the  jumps  of  A 
are  exponentially  distributed.  There  all  of  our  results  can  be  made 
entirely  explicit,  and  we  are  able  to  give  a counterexample  for  a 
conjecture  of  £inlar  and  Pinsky  [3]  concerning  the  recurrence  classi- 
fication of  storage  processes.  Section  6 contains  some  concluding 
remarks  about  the  recurrence  classification  of  storage  processes  for 
which  state  zero  is  inaccessible. 


1+ 


2.  Recurrence  Classification  of  the  Storage  Process. 


The  following  notation  is  necessary  for  what  follows  and  generally 
conforms  to  conventions  used  in  [4]  with  exceptions  to  he  noted.  De- 
note “by  P (•)  the  distribution  on  the  path  space  of  X corresponding 
to  initial  state  x e S and  by  E (*)  the  associated  expectation 
operator.  The  generator  of  X is  ZL  and  the  domain  of  21  is 
(cf.  Breiman  [2],  p.  34l).  With  Q(x)  = X(l  - F(x))  define 
K(x,y)  = Q(x-y)/r(x),  0 <.  y <.  x . The  iterates  of  K are  defined  by 
K^x.y)  = K(x,y)  and  Kn+]_(x,y)  = /*  Kn(x,z  )k( z ,y  )dz  = /*  K(x,z )Kn(z,y)dz 
for  0 <.  y <.  x < oo  . From  Section  3 of  [4]  we  have  Kn+1(x,y) 

<.  An+1[R(x)-R(y)]n/r(x)n!  so  the  kernel  K*(x,y)  = ^n=1  Kn(x,y)  is 
well  defined. 

Let  T = inf{t  > o|x(t)  = 0 and  X(s)  > 0 for  some  s e (0,t)}  . 

We  shall  say  that  X is  recurrent  if  P^(T  < 00 ) = 1 and  transient 
otherwise.  In  the  recurrent  case,  we  say  that  X is  positive  re- 
current if  Eq(T)  < 03  and  null  recurrent  otherwise.  This  definition 
of  positive  recurrence  differs  from  that  used  in  [4] , but  Proposition 
7 of  [4]  shows  the  two  definitions  to  be  equivalent.  The  following 
is  a restatement  of  Theorem  2 of  [4]. 

.CO  # . . 

Theorem  1.  X is  positive  recurrent  iff  JQ  K (.x,0;dx  < 00  . 

In  differentiating  between  the  null  recurrent  and  transient  cases, 
a key  role  is  played  by  the  integral  equation 


(2) 


r (x)u(x) 


■00 

Q(y-x)u(y)dy  , 

'x 


x > 0 . 
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We  shall  say  that  a function  u : (0,-)  - [0  »)  satisfying  (2)  is 

a positive  integrable  solution  if  0 < u(y)dy  < 00  . 

Proposition  1.  If  there  exists  a positive  integrable  solution 

u of  (2) , then 


rx 


Px(T=°°)  = 


u 


(y)dy 


/ 


u(y)dy  > 0 , 


¥x  > 0 , 


and  any  other  positive  integrable  solution  of  (2)  differs  from  u only 
by  a multiplicative  constant. 

Proof:  Let  u be  a positive  integrable  solution  of  (2)  and  de- 

fine U(x)  = J*  u(y)dy/J”  u(y )dy  for  x > 0 . We  begin  by  showing 
that  U is  in  the  domain  $ of  the  generator  *21  of  X . From  (2) 
it  is  immediate  that 


.CO 


r(x)u(x)  < X u(y)dy  £ X u(y)dy  , 
x J0 


x > 0 , 


so  r 


(.)u(*)  is  bounded.  Now  let  z > 0 be  fixed.  For  x < z we 


have 


|r(x)u(x)-r(z)u(z) | = 


,co 


Q(y-x)u(y)dy  - 


X 


Q(y-z)u(y)dy| 


Q(y-x)u(y)dy  - 


Q(y-z)u(y)dy| 


■o° 

+ | Q(y-x)u(y)dy  - 
z 


Q(y-x)u(y)dy I - a(x)  + b(x) 
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Clearly  b(x)  = | /*  Q(y-x)u(y  )dy  | ->  0 as  x + z , and 
a(x)  = \fz  [Q(y-x)  - Q(y-z)]u(y)dy|  . The  integrand  is  bounded  by 
A u(y ) , which  is  integrable,  and  Q(y-x)  - Q(y-z)  -+•  0 for  all  y as 
x t z , since  Q is  right  continuous.  Thus  b(x)  -*  0 as.  x 1 z by 
dominated  convergence,  and  we  conclude  that  r(*)u(*)  is  left  con- 
tinuous. Since  r is  left  continuous  and  strictly  positive  on 
it  follows  that  u is  left  continuous.  From  Proposition  4 of  [4]  and 
its  corollary,  we  then  have  U £ and 


j2/u(x  ) = 


.00 

. Q(y-x)u(y)dy  - r(x)u(x) 
•*x 


= 0 , 


x > 0 . 


Now  suppose  b > 0 , let  x(b)  = inf{t  >.  o|x(t)  >.  b}  , and  let 
* . . 

T - x(b)  A T . Proceeding  as  in  the  proof  of  Theorem  3 of  [4],  one 
can  show  Ex(T*)  < °°  for  0 < x < b , so  from  Dynkin's  identity  (ito 
[5] , p.  2.11.1)  we  have 


(3) 


E U ( X ( T ))  = U (x ) + E 
x x 


i2fu(X(t))dt  = U(x)  . 


Since  U(X(T))  - u(0)  - 0 on  {T  < °°}  , we  have 
W E U(X(T*))  = E [U(X(x(b)))  ; T > x(b)]  . 

-A-  jL 

It  is  easy  to  show  that  x(b)  ->  °°  P - a.s.  as  b so 

x 

PX(T  > x(b))  1 Px(T  = 00 ) as  b °°  . Since  from  (4)  we  have 
(recall  U(°°)  = l) 
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IP  (T  > x(b))  ^ E [U(X(x(b) ) ) ; T > x(b)] 
x x 


> U(b ) Px(T  > x(b) ) 


we  conclude  from  (3)  and  (4)  that  U(x)  - Px(T  - 00 ) f°r  x > 0 . Thus, 

p (T  = oo)  > 0 for  sufficiently  large  x . Combining  this  with  the 
x 

strong  Markov  property  of  X and  Theorem  3 of  [4]  and  its  corollary , 
it  follows  that  Px(T  = oo)>o  ¥x>0. 

Let  u*  be  any  other  positive  integrable  solution  of  (2)  and  let 
U*(x)  = J*  u*(y)dy/j“  u*(y)dy  for  x >.  0 . By  repeating  the  argument 

above,  we  get  U*(x)  = ?x(T  = °°)  = U(x)  for  all  x > 0 , and  the  last 

, * 

statement  of  the  proposition  follows  directly,  since  u and  u are 
left  continuous. 

Proposition  2.  If  there  exists  no  positive  integrable  solution 
of  (2),  then  PX(T  = 00 ) = 0 for  all  x > 0 . 

Proof:  Let  U(x)  = Px(T  = °°)  for  x > 0 . Proceeding  exactly 

as  in  the  proof  of  Theorem  3 of  [4]  by  conditioning  on  the  time  of 
the  first  jump,  one  can  show  that  U(x)  = u(y)dy  , where  u is 
the  left  derivative  of  U on  (O,00)  and  satisfies 


(5) 


r(x)u(x)  = X 


f°° 

[U(x+z)  - U(x)]F(dz) 


S 


x > 0 . 


From  the  path  structure  of  X it  is  immediate  that  U is  non-de- 
creasing, so  u is  non-negative.  We  can  rewrite  U(x+z)  - U(x)  as 
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an  integral  of  u an  (5)  and  reverse  the  order  of  integration  by 
Pubini's  Theorem.  The  result  shows  that  u satisfies  (2).  If  there 
exists  no  positive  integrable  solution  of  (2),  it  follows  that  u E 0 
and  hence  U = 0 , which  completes  the  proof. 

Theorem_2_.  X is  transient  iff  there  exists  a positive  integra- 
ble solution  u of  (2). 

Proof:  Defining  U(x)  = P^T  = »)  for  x > 0 , the  strong  Markov 

property  of  X gives  us 


po(T  = 


= EQ[U(X(t1) )]  - 


U(x)F(dx) 


and  the  theorem  is  then  immediate  from  Propositions  1 and  2. 

— - : Combining  Theorems  1 and  2,  we  see  that  there  cannot 
exist  a positive  integrable  solution  of  (2)  when  /"  K*(x,0)dx  < « 
This  can  be  seen  analytically  as  follows:  Setting  cj>(x)  = r(x)u(x) 
we  rewrite  (2)  as 


(2 


<f>(x) 


.00 

<p(y)  K(y,x)dy  = 


[CO 

<f>(y)  K (y,x)dy  . 
x n 


If  u(x)  is  an  integrable  solution  of  (2)  we  will  show  that 
r°°  . 

Jq  K (z,0)dz  < 00  requires  u = <f>  = 0 . Rewriting  (2)  as 

= / q (U(x+s)  - U(x))A  F(ds)  shows  that  <f>(x)  <.  A.  U(°°),  ¥x  so 
that  from  ( 2 ' ) 


cj>(x)  <L  A U(oo) 


[CO 

■'x 


Kn(y>x)dy  • 
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/°°  * / \ 

0 K ( z , 0 ) dz  < “ implies 

¥x  > 0 /°°  K*(y ,x)dy  < 00  and  the  desired  result  follows  by  letting  n °° 

X 

roo  ^ , v 

Theorem  3.  X is  null  recurrent  iff  JQ  K (x,0)dx  = °°  , and  there 
exists  no  positive  integrable  solution  of  (2). 

Proof:  Immediate  from  Theorems  1 and  2. 
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3.  The  Risk  Process  and  its  Generator. 

Throughout  this  section  and  the  next,  we  assume  that  R(°°)  = 00  . 
Since  R(*)  is  strictly  increasing  on  S , we  can  speak  unambiguously 
of  R 1(t)  for  t >.  0 . We  define  q#(x,t)  = R_1(R(x)+t)  for  x >.  0 
and  t 1 0 , so 

M ft  ft 

(6)  <r(x,t)  = x + r (q" (x,s ) )ds  = x + rMq#(x,s))ds 

0 0 

for  x >_  0 and  t >.  0 . The  second  equality  in  (6)  follows  from  the 
fact  that  q(x , • ) is  strictly  increasing  and  r can  differ  from  its 
right  limit  r#  at  only  countably  many  points.  Suppose  that  t^tg,... 
are  the  Poisson  jump  times  of  A and  Y^Yg,...  are  the  successive 
jump  sizes.  Then  the  risk  process  with  starting  state  x e S is 

constructively  defined  by 

X#(t)  = q^(x,t)  , 

= [q#(x,t1)  - Y1]  + 

X#(tx+  t)  = q#(X#(t1),t) 

X#(t2)  = [q^(X#(t1),  t2-  t1)  - Yg]+  , 

and  so  forth.  Note  that  t ->  °°  as  n + ® , so  X^(t)  is  well  defined 
for  all  t >.  0 . Also,  observe  that  assumption  (l)  and  the  requirement 
r(oo)  = oo  are  necessary  for  the  construction  to  make  sense.  If  (l) 


0 <.  t < t1  , 


0 < t < t?  - tx  , 
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00 


does  not  hold,  then  Xff  cannot  get  away  from  state  zero.  If  R(°°)  < 

jf 

then  explosions  in  X are  possible.  (More  precisely,  an  explosion 
is  inevitable.) 

# 

One  can  show  that  X is  a strong  Markov  process  with  standard, 
stationary  transition  probabilities.  This  can  be  done  by  brute  force 
or  by  using  Corollary  2 of  Ito  [5] , p.  2.  12.  13.  together  with  (ll) 
below. 

We  denote  by  P^(*)  the  distribution  on  the  path  space  of  X 
corresponding  to  initial  state  x £ S and  by  Ex(‘)  Phe  corresponding 
expectation  operator.  This  notation,  and  all  of  that  to  come,  para- 
llels precisely  the  notation  for  X used  in  [it]. 

n 

Let  oc  be  the  set  of  bounded,  measurable  f : S •+  R such  that 
•g#  f(X^(t))  -*■  f(x)  as  t 4-  0 ¥x  e S . Also,  let  be  the  set  of 

f £ •(?  such  that  [E^  f(X^(t))  - f(x)]/t  converges  boundedly  point- 

# X 

wise  on  S as  t 4-  0 to  a function  (denoted  mjJ f)  in  . We  call 
the  operator  thus  defined  on  # the  generator  of  X^  . Finally, 

for  each  a > 0 and  bounded,  measurable  f : S ->■  R , we  define  the 
resolvent 


R^  f ( x ) = E# 
a x 

The  following  is  a standard  result  in  the  theory  of  Markov  processes, 
cf.  Breiman  [2] , p.  3^2. 

Proposition  3.  For  all  a > 0 , R^  and 


e"*at  f(X#(t))dt 


X £ S 


12 


(7)  h(x)  + j2?rJ  h(x)  - a rJ  h(x)  - 0 ¥x  e S,  h e ^ . 

. ypft 

Proposition  4.  The  set  <£■  consists  of  all  hounded  functions 

M 

f : S ->  R that  are  right  continuous.  The  domain  oU  consists  of 
all  hounded,  absolutely  continuous  functions  f : S -*■  R that  have 
a right  derivative  f on  (0,°°)  such  that  r^(x)f'(x)  is  hounded 

and  right  continuous  on  (0,°°)  and  approaches  a finite  limit  as 

A*  ft 

x + 0 . Furthermore , for  f e JJ  , 

n rx 

r(x)  = r#(x)f'(x)  - Q(x-y)f ' (y)dy  ¥x  > 0 , 

J0 

(8) 

{0)  - lim  r^(x)f'(x) 
x+0 

u 

Remark : Since  is  strictly  positive  and  right  continuous 

on  (O,00)  , it  follows  that  f is  right  continuous  on  (0,°°)  if 
f e . Also,  if  the  right  limit  r^(0)  exists  and  is  positive, 

then  each  f e must  have  a (finite)  right  derivative  at  zero. 

ft 

Proof:  The  characterization  of  follows  from  the  fact 

that  q^(x,t)  lx  as  t \ 0 and  f (X^(t ) ) = f (q# (x ,t ) ) exp (-At ) + o (l ) 

X 

as  t + 0 . 

Suppose  f e & . Then  f = R^h  for  some  a > 0 and  h £ otf 

ft 

hy  Proposition  3.  Using  the  strong  Markov  property  of  X , we  have 
f^l  -at 

(9)  f(x)  = E^  e_at  h(q^(x,t)  )dt+  e 1 f([q^(x,t  ) - Y ] + ) 
x j o x 11 
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•¥x  £ S . Let  W(y)  = / y f(y-z)F(dz)  + f(0)[l-F(y)]  for  y >.  0 . 

\ 

(Thus,  W(0)  = f(0).)  Using  the  definitive  relationship  (6)  for 
q^(*,*)  and  the  independence  of  t and  , we  can  manipulate 

(9)  to  obtain 

(10)  f(x)  = ^y[h(y)  + A W(y)]e~(A+a) (R(y)_R(x) V ¥x  e S . 

Now  rewrite  (10)  as 

-OO 

(11)  f(x)  = e(X+a^R(x)  p^y[h(y)  + A W(y ) ]e" (X+a)R(y ^y 

¥x  e S , and  observe  that  both  factors  are  absolutely,  continuous. 

Since  f is  the  product  of  absolutely  continuous  functions,  it  is 
absolutely  continuous.  From  the  definition  of  R(')  it  follows 
that  the  first  factor  on  the  right  side  of  (ll)  has  right  derivative 
exp [ (A+a)R(x) ] /r#(x)  at  x > 0 . Using  the  continuity  and  bounded- 
ness of  f , one  can  easily  show  that  W is  right  continuous  and 
bounded,  and  h is  right  continuous  and  bounded  by  the  first  part 
of  the  proposition.  Thus,  for  x > 0 , the  integrand  in  (ll)  approaches 

(12)  [h(x ) + A W(x)]e_^A+a^R^X^/r#(x) 

as  y + x , implying  that  the  integral  factor  is  right  differentiable 
at  x and  its  right  derivative  is  the  negative  of  (12).  Thus,  right 
differentiating  (ll),  f has  right  derivative 


lit 


(13)  f (x)  = (A+a)f (x)/r#(x)  - [h(x)  + A W(x)]/r^(x)  ¥x  > 0 . 


(We  have  re-used  (ll)  to  simplify  the  first  term  on  the  right  in  (13).) 
Multiplying  through  by  r^(x)  , we  have 


(lU)  h(x)  = a f ( x ) - r^(x)f ' (x)  + A[f(x)-W(x)]  ¥x  > 0 . 


It  follows  that  r^( • )f' ( ' ) is  hounded  and  right  continuous  on 
(O,00)  , since  all  other  terms  in  (lU)  are  hounded  and  right  contin- 
uous. Furthermore,  observing  that  W(x)  ■+  W(0)  = f(0)  as  x + 0 , 
we  let  x 1 0 in  (lM  to  qhtain 


(15) 


lim  r^(x)f'(x)  = a f(0)  - h(0)  . 
xiO 


Noting  that  f'  is  a version  of  the  density  of  f , we  use  the  de- 
finition of  ¥ and  Fuhini's  Theorem  to  obtain 


(l6)  A[f(x)-W(x)]  = A 


[f (x)-f (x-y )]F(dy)  + A[l-F(x)] [f (x)-f(O)] 


= A 


= A 


x 


x 
x-y 

rx 


f'(z)dz  F(dy)  + A[l-F(x)] [f (x)-f (0 )] 


0 X— 5 


F(dy)f'(z)dz  + A[l-F(x)][f(x)-f(0)] 


rx 


= A 


[l-F(x-z ) ] f ' ( z )dz  = 


rx 


Q(x-y)f  (y )dy  ¥x  > 0 
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Substituting  (l 6)  into  (l4)  then  yields 


(17) 


h(x)  = a f(x)  - [r^(x)f'(x) 


■x 

Q(x-y  )f ' (y  )dy]  *fx  > 0 . 
JO 


We  know  from  Proposition  3 that  h(x)  + f(x)  - a f(x)  = 0 fees, 
and  combining  this  with  (15)  and  (17)  proves  that  is  given  by 

(8). 

¥e  have  now  shown  that  every  function  f e JO  has  the  pro- 
perties enumerated  in  the  proposition  and  that  ^f  is  given  by 
(9)-  It  remains  to  show  that  every  function  f : S -»-  R with  the 
enumerated  properties  satisfies  f = R"h  for  some  a > 0 and 
h £ «£  . This  we  do  by  reversing  the  logic  of  the  previous  para- 

graph. Let  f be  any  such  function,  pick  a > 0 arbitrarily,  de- 
fine ¥ in  terms  of  f as  above,  and  define  h in  terms  of  f 
by  (l4)  and  (15)«  Then  h e . Dividing  (l4)  through  by  r^(x) 
for  x > 0 gives  (13),  and  integrating  this  over  (0,x)  gives  (ll). 
This  is  equivalent  to  (9),  from  which  it  follows  easily  that  R^h  = f , 
completing  the  proof. 
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4.  Recurrence  Classification  of  the  Risk  Process. 


Let  = inf{t  > o|x#(t)  = 0}  and  observe  that  P^(T^  > 0)  = 1 
We  shall  say  that  X is  recurrent  if  P^(Tff  < °°)  = 1 and  transient 
otherwise.  In  the  recurrent  case,  we  shall  say  that  X^  is  positive 
re current,  if  E^(T  ) < 00  and  null  recurrent  otherwise.  For  x >_  0 , 

let  T^(x)  = inf{t  > 0|x^(t)  = x},  so  = T^(0)  . If  0 <.  x < b 

it  is  quite  easy  to  show  that  Px(T  (b )<«>)  = p 5 using  the  fact 

that  X cannot  get  above  level  b without  hitting  it . 

Proposition  5.  If  0 _<  x < b < °°  then 


pW 

x 


< T#(b))  = 


rb 


K (y ,0 )dy/ 


x 


1 + 


fb  » 

K (y,0)dy 

J0 


Proof:  Consider  a storage  process  XQ  = {XQ(t),  t .>  0}  on  S 

with  release  rule  rQ(-)  satisfying  rQ(o)  = 0 and  r (x)  = r#(b-x) 
for  0 < x < b . The  form  of  rg(’)  on  [t,00)  will  be  immaterial 
for  our  purpose.  Let  the  input  process  for  XQ  be  A and  let  the 
initial  state  be  XQ(0)  = b-x  so  that  XQ(t)  = b-X#(t)  for 
0_<t<T  A T (b)  and  < T^(b))  is  the  probability  that  X^ 

hits  or  exceeds  level  b before  hitting  level  zero.  The  current 
proposition  is  then  a direct  application  of  Theorem  3 of  Harrison  and 
Resnick  [4] . 

Theorem  4.  If  jQ  K (y,0)dy  = <»  , then  P*(T  < «>)  = 1 ¥x  > 0 . 
Otherwise 


IT 


<1  ¥x  _>  0 . 


P^(T#  < 00 ) = 
X 


r , / 

r 

r°°  * 

K (y ,0 )dy / 

1 + 

K (y,0)dy 

Jx  / 

L J 

0 J 

it  ^ 

Thus  Xw  is  transient  iff  /”  K (y,0)dy  < °°  . 

jf 

Proof : With  X (0)  = x < b , it  is  immediate  from  our  construc- 

u 

tion  that  T (b)  >.  R(b)  - R(x)  -*■  00  as  b -*■  <»  . Thus, 

MUM  U U 

P (T  < T (b))  i P (T  < 00 ) as  b + “ . The  theorem  is  then  imme- 

-A-  X 

diate  from  Proposition  5- 

We  say  that  a probability  measure  y#  on  (S,«$)  is  a stationary 
u 

distribution  for  X if 


Pf  (X#(t)  e B)y#(dx)  = y#(B)  ¥t  > 0,  B e JL  . 

J S 

u 

Proposition  6.  There  exists  a stationary  distribution  for  T 
iff  there  exists  a positive  integrable  solution  u of  (2),  in  which 
case  the  unique  stationary  distribution  is  absolutely  continuous  with 
density  proportional  to  u . 

# 

Proof:  It  is  known  that  y is  a stationary  distribution  for 

u 

X iff 


(18) 


^f(x)y#(dx)  = 0 ¥f  e , 

JS 


cf.  Breiman  [2],  p.  3^6,  or  Azema,  Duflo  and  Revuz  [1],  Lemma  1. 

Assume  f £ # with  r#(x)f'(x)  -*  a as  x 1 0 . If  y # is  a 

probability  measure,  then  (9)  and  Fubini's  Theorem  give  us 


18 


(19)  ^ff(x)Y#(dx)  = a y#{0}  + [ r#(x)f ' (x)y#(dx) 

JS  J 0 

.00  -x 

Q(x-y)f ' (y)dyY^(dx) 

J0 

r°°  r00  r°° 

= a Y (O)  + r#(x)f ' (x)Y^(dx)  - Q(y-x)Y#(dy)f ' (x)dx  . 

J0  J0  Jx 

Suppose  that  u is  a positive  integrable  solution  of  (2)  and 
ft 

that  Y is  an  absolutely  continuous  probability  measure  with  den- 
sity  proportional  to  u . Then  Y i0>  = 0 , and  it  is  immediate  from 

jj 

(2)  and  (19)  that  (l8)  holds.  Thus  V is  a stationary  distribution. 

u 

Now  suppose  conversely  that  y is  a stationary  distribution, 
so  (l8)  holds.  Assume  b > 0 and  let  I = (0,b)  . Let  f : S ->-  R 
be  absolutely  continuous  with  density  f'(x)  = l/r#(x)  on  I and 
f'(x)  = 0 otherwise.  Then  r#(x)f'(x)  1 as  x i 0 , and  it  follows 

JJ 

from  Proposition  h that  f e . From  (18)  and  (19)  we  have 

# r13  # fbr  i f°°  u 1 

0 - Y {0}  + Y (<ix)  - — Q(y-x)y#(dy)  dx 

J0  ■'OLr^(x)  x 

Letting  b 4-  0 shows  that  y{0}  = 0 , and  since  b is  arbitrary  we 


Y^(dx) 


p 00  * 

Q(y-x)Y^(dy)  dx 

x J 


Thus,  y has  a density  on  (0,oo)  satisfying 
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r^(x)u^(x)  = 


.CO 


x > 0 . 


Q(y-x)u#(y)dy  , 

Let  u(x)  = f°  Q(y-x)u^(y)dy/r(x)  for  x > 0 . Then  u(x)  = u^(x) 
almost  everywhere,  since  r differs  from  r^  at  only  countably  many 
points,  and  it  follows  both  that  u is  a positive  integrable  solu- 
tion  of  (2)  and  that  u is  a version  of  the  density  of  y • The 
uniqueness  of  the  stationary  distribution  follows  from  the  last  state- 
ment of  Proposition  1. 

M 

Theorem  5.  X is  positive  recurrent  iff  there  exists  a positive 
integrable  solution  of  (2),  in  which  case 

P#(X#(t)  e B)  -*  y#(B)  as  t->°°  ¥xeS,Be  x£.  , 

X 

# # 

where  y is  the  unique  stationary  distribution  of  X . 

Proof:  The  argument  is  virtually  identical  to  the  proofs  of 

Proposition  8 and  Theorem  2 of  [4] , so  we  only  sketch  it.  The  times 
a 

at  which  X hits  zero  constitute  a sequence  of  regeneration  points. 

The  duration  of  a regenerative  cycle  is  distributed  as  T when 
u 

X (0)  = 0 . It  is  easy  to  show  that  this  distribution  is  non-arithmetic. 

# # 

It  has  finite  expectation  iff  X is  positive  recurrent.  If  X is 
positive  recurrent,  then  Smith's  Theorem  for  regenerative  processes 

U M 

shows  that  Pff(Xi7(t)  e B)  -*  tt(b)  as  t °°  , and  it  is  easily  es- 

X 

tablished  that  the  limit  distribution  it  is  a stationary  distribution 

# # 

for  X . If  X is  not  positive  recurrent,  then  a standard  renewal 
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ft  f ft 

theoretic  argument  shows  that  P^(X  (t)  e B)  -»•  0 as  t -*■  00  ¥x  e S 
and  hounded  B e 4 > and  it  follows  directly  that  does  not  have 

a stationary  distribution.  Combining  these  facts  with  Proposition  6 
proves  the  theorem. 

/"  $ • fOO  ^ / \ 

Theorem  6.  X is  null  recurrent  iff  Jq  K (y,0)dy  = 00  and 
there  exists  no  positive  integrable  solution  of  (2). 

Proof:  Immediate  from  Theorems  4 and  5 • 

Thus,  we  see  that  X is  positive  recurrent  iff  X is  transient, 
X is  null  recurrent  iff  X is  null  recurrent  and  X is  transient 
iff  X is  positive  recurrent. 
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5.  The  Case  of  Exponential  Jumps, 

Suppose  that  F is  an  exponential  distribution  with  mean  l/y  , 
so  Q(x)  = X exp(-yx)  for  x k.  0 . In  Harrison  and  Resnick  [4]  it 
is  shown  that 


(20) 


K (x,0)  = y p(x)  exp 


x 

-y  | (l-p(y))dy 
0 


x >.  0 , 


where  p(x)  = A/yr(x)  for  x > 0 . Also,  our  integral  equation  (2) 
becomes  in  this  case 


(21) 


•(x)u(x) 


x > 0 


Setting  <|>(x)  = I™  e ^u(y)dy  , we  can  rewrite  (2l)  as 

X 

X <|>(x)  = -r(x)c})'(x)  for  x > 0 . Solving  this  elementary  differential 
equation,  we  find  that  the  only  non-trivial,  non-negative  solutions  of 
(2)  are  of  the  form 


(22) 


u(x)  = c p(x)  exp 

y 

rx  1 

(l-p(y) )dy 

0 

x > 0 , 


where  c < 0 . Combining  this  with  Theorem  4 gives  an  explicit  cri- 
terion for  recurrence  of  the  risk  'process  and  a closed-form  solution 
for  the  probability  of  ruin  in  the  transient  case. 

In  the  context  of  storage  processes  , an  interesting  case  is  that 
where  p(x)  1 1 as  x f 00  . From  Theorem  1 and  (20)  we  see  that  X 


22 


cannot  then  he  positive  recurrent.  Cinlar  and  Pinsky  [3]  have  con- 
jectured that  X is  null  recurrent,  hut  from  (22)  and  Theorems  2 
and  3 it  is  clear  that  this  need  not  he  the  case.  The  storage  process 
may  he  either  transient  or  null  recurrent  (u  may  he  either  integrahle 
or  not),  depending  on  the  speed  at  which  p(*)  approaches  unity. 
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6.  Concluding  Remarks. 

Consider  the  storage  process  X , and  suppose  that  the  release 
rule  r fails  to  satisfy  (l).  State  zero  is  then  inaccessible,  and 
the  recurrence  classification  used  in  Section  3 (focusing  on  the  dis- 
tribution of  the  return  time  to  state  zero)  is  inappropriate.  De- 
noting by  T(y)  the  first  hitting  time  of  state  y > 0 , it  is  quite 
easy  to  show  that  either 

(a)  P (T(y)  < °°)  < 1 ¥0<y.<x<°°,  or 

(b)  P (T(y)  < oo ) = l and  E (T(y))  = <=°  ¥0<y<x<°°,  or 

X X 

(c)  P (T(y)  < oo ) = 1 and  E (T(y))  < » ¥0<y<x<“. 

X X 

Furthermore,  in  the  case  where  zero  is  accessible,  conditions  (a),  (b), 
and  (c)  correspond  to  transience,  null  recurrence  and  positive  recur- 
rence as  we  have  defined  them  in  Section  2.  When  assumption  (l)  fails, 
we  may  simply  define  the  recurrence  classifications  by  (a)-(c)  . 

Given  that  (a)-(c)  are  mutually  exclusive  and  exhaustive,  it 
is  clear  that  the  recurrence  classification  of  X depends  only  on 
(r(x)  : x >.  a}  where  a > 0 is  arbitrary.  More  particularly, 
choosing  a > 0 arbitrarily,  X must  have  the  same  recurrence  clas- 
sification as  another  storage  process  X .having  input  A and  re- 

8, 

lease  rule  r (x)  = r(x+a)  for  x > 0 . Since  r^(0)  = r^(a)  > 0 , 
a a 

the  release  rule  r satisfies  assumption  (l),  and  thus  Theorems  1-3 

8, 

2k 


can  be  used  for  the  recurrence  classification  of  X . Theorem  1 

a 

& 

shows  that  X&  is  positive  recurrent  iff  K (x,0)  is  integrable, 

* / \ 

where  K (*,*)  is  defined  in  terms  of  r and  Q in  the  obvious 

04  Q, 

way,  and  it  is  easy  to  show  that  K (x,0)  = K (a+x,a)  for  all  x > 0 . 

04 

Thus,  our  necessary  and  sufficient  condition  for  positive  recurrence 
is 


K (x,a)dx 


< CO 


Theorem  2 shows  that  X&  is  transient  iff  there  exists  a positive 
integrable  solution  u of  equation  (2)  with  r in  place  of  r . 

04  0 

But  it  is  easy  to  show  that  any  such  u has  the  form 

a 

u (x)  = u(a+x),  x > 0 , where  u is  a positive  integrable  solution 
0 

of  (2)  over  the  restricted  range  x > a . Thus,  the  necessary  and 
sufficient  condition  for  transience  is  the  existence  of  a non-negative 
solution  u of  (2)  such  that 


0 < 


[CO 

u(x)dx  < 00  . 
a 
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20.  ABSTRACT.  J.  Michael  Harrison  and  Sidney  Resnick 

Consider  a storage  process  X = {x(t),t  >.  0}  with  compound 
Poisson  input  process  A = {A(t),t  >.  0}  and  release  rule  r(-) 
which  is  arbitrary  except  for  the  requirement  that  state  zero  be 
accessible.  In  a previous  paper,  we  derived  necessary  and  sufficient 
conditions  for  the  Markov  process  X to  be  positive  recurrent.  Here 
we  complete  the  recurrence  classification  of  X , providing  necessary 
and  sufficient  conditions  for  null  recurrence  and  transience. 

Closely  related  to  X is  a Markov  process  X^  = {X^(t),t  >.  0} 

jf 

which  increases  at  rate  r(X  (t))  between  negative  jumps.  The  jumps 
are  generated  by  A except  that  they  are  truncated  as  necessary  to 
keep  the  process  non-negative.  It  is  shown  that  the  risk  process 

ft 

X is  transient  iff  X is  positive  recurrent,  null  recurrent  iff 
X is  null  recurrent,  and  positive  recurrent  iff  X is  transient. 

In  the  transient  case,  we  calculate  the  probability  that  X#  ever 
hits  level  zero  (the  probability  of  ruin)  as  a function  of  the  initial 
state  X^(0)  . 
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